


CHILD DEVELOPMENT 


Child Development, March/April 2010, Volume 81, Number 2, Pages 435-456 


The Significance of Insecure Attachment and Disorganization in the 
Development of Children’s Externalizing Behavior: A Meta-Analytic Study 


R. Pasco Fearon 
University of Reading 


Anne-Marie Lapsley 
Barnet, Enfield & Haringey Mental Health 
NHS Trust 


Marian J. Bakermans-Kranenburg 
and Marinus H. van IJzendoorn 
University of Leiden 


Glenn I. Roisman 
University of Illinois at Urbana-Champaign 


This study addresses the extent to which insecure and disorganized attachments increase risk for externaliz- 
ing problems using meta-analysis. From 69 samples (N = 5,947), the association between insecurity and exter- 
nalizing problems was significant, d = 0.31 (95% CI: 0.23, 0.40). Larger effects were found for boys (d = 0.35), 
clinical samples (d = 0.49), and from observation-based outcome assessments (d = 0.58). Larger effects were 
found for attachment assessments other than the Strange Situation. Overall, disorganized children appeared 
at elevated risk (d = 0.34, 95% CI: 0.18, 0.50), with weaker effects for avoidance (d = 0.12, 95% CI: 0.03, 0.21) 
and resistance (d = 0.11, 95% CI: —0.04, 0.26). The results are discussed in terms of the potential significance 


of attachment for mental health. 


Although the significance of the parent-child rela- 
tionship was recognized by scientists and clinicians 
since the earliest days of formal psychological 
inquiry (e.g., Baldwin, 1895; Freud, 1908; James, 
1890), two major advances occurred in the 1960s 
and 1970s that created lasting legacies for the study 
of human development. John Bowlby’s (1969) the- 
ory of parent-child attachment was revolutionary 
in the way it integrated evolutionary, biological, 
developmental, and cognitive concepts into a uni- 
fied account of human attachment behavior. This 
remarkable achievement paved the way for the 
scientific study of attachment, largely because it 
created a conceptual framework for developing 
testable hypotheses about causal influences, devel- 
opmental processes, and expected long-term conse- 
quences of attachment for mental health 
(Bretherton, 1997). Critical among these novel con- 
tributions were the clear characterization of the 
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proximal behavioral functions associated with 
attachment and their interplay with other biologi- 
cally significant behavioral systems, the use of 
comparative evidence as crucial sources of theory- 
development, and the concept of an _ internal 
working model as a framework for understanding 
continuities in attachment behavior across context 
and over time. The notion that the quality or 
organization of attachment behavior in early 
infancy or childhood might have implications for 
later socioemotional development and mental 
health is arguably one of attachment theory’s most 
well-known and contested predictions (Lamb, 
Thompson, Gardner, Charnov, & Estes, 1984; 
Rutter, 1995). Nowhere is this issue more significant 
than in the domain of aggression and externalizing 
behavior problems, where the social costs are 
substantial (Loeber & Hay, 1997). 

Researchers working in the attachment field, 
following Bowlby and others, have considered a 
number of mechanisms that might explain why 
attachment experiences in early life might be asso- 
ciated with later adaptation and mental health. 
Several theorists have suggested that the role 
of attachment may center on the way in which 
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children respond to sources of threat and challenge, 
and the extent to which children are able to draw 
on parental support and comfort as a means of cop- 
ing (Kobak, Cassidy, Lyons Ruth, & Ziv, 2005). 
Secure children, it is maintained, have had repeated 
experiences of a caregiver who is responsive when 
support and proximity are needed and expect the 
caregiver(s) to be available and comforting when 
called upon. In contrast, children with insecure 
attachment relationships may have had experiences 
in which bids for proximity have been discouraged, 
rejected, or inconsistently responded to and rely 
more heavily on secondary coping processes to deal 
with stress and challenge. 

Developmental continuities between the organi- 
zation of the attachment relationship and func- 
tioning beyond it (in time or space) have 
generally been conceptualized with reference to 
the internal working models construct. This 
important conceptual heuristic is thought of as a 
set of organized cognitive—affective psychological 
structures that organize thinking, feeling, and 
behavior vis-a-vis the attachment figure as a 
potential haven of safety and comfort in times of 
stress (Bretherton, 1995; Main, Kaplan, & Cassidy, 
1985). These models are thought to become gener- 
alized over time and influence functioning in 
wider interpersonal relationships across the life 
span and form the basis of a generalized sense of 
the self as worthy of love and care and others as 
available and responsive (Cassidy, 1988; Sroufe, 
Egeland, Carlson, & Collins, 2005a). In addition to 
this primary explanatory construct, several other 
factors (possibly related to internal working mod- 
els) have been discussed as potential mediators 
between a secure attachment relationship and 
lowered risk for mental health problems generally 
and externalizing problems more specifically, such 
as (a) a developing sense of self-confidence 
through repeated experiences of support and com- 
fort and through effective exploration of the envi- 
ronment (Goldberg, 1997), (b) generalized positive 
social expectations (as opposed to mistrust and 
perceived hostility; see Dodge & Coie, 1987), (c) 
the socialization of moral emotions and values 
within a secure attachment relationship (Ko- 
chanska, 1997; van IJzendoorn, 1997), (d) model- 
ing of prosocial behavior by a sensitive caregiver 
(Guttmann-Steinmetz & Crowell, 2006), (e) conti- 
nuity in the quality and supportiveness of ongo- 
ing parental care (Lamb et al., 1984), and (f) the 
capacity for effective emotion regulation (e.g., 
Cassidy, 1994). Other possibilities exist that have 
been given less attention, such as the social mod- 


ulation of biological systems mediating stress and 
arousal regulation (e.g., Suomi, 2003; Weaver 
et al., 2004). 

Although Bowlby’s work was highly influential, 
the development of a standardized procedure for 
the systematic study of attachment behavior, as 
observed in a naturalistic setting, was a major fur- 
ther step forward in the establishment of an empiri- 
cal knowledge base concerning the developmental 
significance of attachment (Ainsworth, Blehar, 
Waters, & Wall, 1978; Sroufe, 1983). Ainsworth 
et al.’s (1978) Strange Situation procedure (SSP) has 
become one of the most widely used—if not the 
most widely used—standardized lab assessment of 
early childhood behavior based on direct observa- 
tion and represents a paradigm example of how to 
systematically study naturally occurring behavior 
in quasi-naturalistic contexts. The identification of 
individual differences in patterns of reunion behav- 
ior following separation in the SSP triggered a pro- 
gram of research studies aimed at uncovering their 
developmental antecedents and sequelae (Belsky & 
Isabella, 1988; Schneider-Rosen & Rothbaum, 1993). 
Despite the accumulation of an impressive volume 
of data over the years, the picture that unfolded 
regarding the developmental consequences of 
attachment has proved complex and often contra- 
dictory, particularly in the domain of mental health 
and psychopathology (Goldberg, 1997). 

One of the earliest and most influential longitu- 
dinal studies of the psychosocial outcomes of chil- 
dren observed in the SSP in infancy was launched 
in Minnesota by Byron Egeland, Alan Sroufe, and 
colleagues (see Sroufe, Egeland, Carlson, & Collins, 
2005a, 2005b). Erickson, Sroufe, and Egeland (1985) 
followed their relatively large sample of high-risk 
infants from 12 months to preschool and collected 
extensive assessments of children’s behavior using 
observer and teacher ratings of social competence, 
ego control, peer confidence, and externalizing 
behavior problems in the school setting. Most 
importantly for the current purposes, secure chil- 
dren scored lower than insecure children on assess- 
ments of behavior problems and avoidant children 
stood out as being particularly at risk, a finding 
echoed in several later studies (Burgess, Marshall, 
Rubin, & Fox, 2003; Goldberg, Gotowiec, & Sim- 
mons, 1995; Munson, McMahon, & Spieker, 2001). 
Interestingly, a later report from the Minnesota 
study at Grades 1-3 (Renken, Egeland, Marvinney, 
Mangelsdorf, etal., 1989) found associations 
between attachment insecurity and externalizing 
problems in boys but not girls (see also Lewis, 
Feiring, McGuffog, & Jaskir, 1984). 


In a manner that was to become somewhat charac- 
teristic of the topic, the first reports of these findings 
were followed immediately by a nonreplication. In 
the same monograph, Bates, Maslin, and Frankel 
(1985) reported on a longitudinal follow-up of 120 
infants who had previously been observed in the 
SSP at 12 months and found no association between 
attachment security and parent reports of external- 
izing behavior problems at age 3. Any number of 
methodological factors could be considered when 
interpreting these early, apparently contradictory 
findings. Notably, Erickson et al.’s (1985) study 
excluded cases that were not stable in terms 
of attachment classifications between 12 and 
18 months, while Bates et al. (1985) only collected 
attachment data at 12 months. There are obvious rea- 
sons why the stability of attachment might be a factor 
in its predictive power. Furthermore, Sroufe et al.’s 
study was drawn from a substantially more impover- 
ished population than the Bates et al. study, which 
was predominantly middle class. A number of 
authors have argued that attachment security 
should be thought of as an interactive risk factor 
that is more significant when other psychosocial 
stressors are present in the family ecology (Belsky 
& Fearon, 2002; Kobak et al., 2005). The two studies 
also employed different outcome measures (teacher 
vs. parent report), which in turn may index contex- 
tual differences in the expression of externalizing 
behavior or in the validity of the assessments. 

Thus, even in the earliest phase of research into 
the longitudinal outcomes of attachment security 
and insecurity, positive findings, negative findings, 
and interactions emerged in almost equal measure. 
A similar mix of results emerged from later studies 
conducted in the 1980s and early 1990s. With such 
a complex pattern of study outcomes, narrative 
reviews took diverging positions regarding the sta- 
tus of the evidence for an association between 
attachment and children’s behavior problems (see 
Belsky & Nezworski, 1988). 

The identification of disorganized attachment 
(Main & Solomon, 1986, 1990) led to renewed inter- 
est in the potential for attachment to predict 
robustly externalizing behavior problems (Carlson, 
1998; Lyons Ruth, Alpern, & Repacholi, 1993; Moss, 
Cyr, & Dubois Comtois, 2004). These seemingly 
inexplicable, contradictory, and fragmentary behav- 
iors observed during the SSP are considered by 
many to represent relational processes at special risk 
for psychopathology, particularly in the domain of 
childhood aggression (Liotti, 1992; Lyons Ruth, Zea- 
nah, & Benoit, 2003; Main & Morgan, 1996; Moss, 
Cyr, et al., 2004). Several authors have outlined 
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hypotheses regarding the mechanisms by which dis- 
organized attachment may lead to aggression, with 
considerable attention focusing on states of emo- 
tional dysregulation and dissociative processes that 
may block the person’s awareness of his or her vio- 
lent actions (e.g., Fonagy, 2004; Liotti, 1992; Solomon 
& George, 1999). Subsequently, a sizable body of 
evidence emerged that was consistent with the view 
that disorganized attachment may be associated 
with increased risk for externalizing behavior prob- 
lems and aggression. A meta-analysis of 12 studies 
carried out in 1999 (van JJzendoorn, Schuengel, & 
Bakermans-Kranenburg, 1999) showed that this 
association was robust, with a mean effect size of 
r = .29 (N = 734). Nevertheless, since 1999 a signifi- 
cant number of new studies have been conducted, 
including the largest ever longitudinal study of 
attachment (with more than 1,000 participants), the 
National Institute of Child Health and Human 
Development (NICHD) Study of Early Child Care 
and Youth Development, which failed to find strong 
evidence of greater externalizing behavior problems 
in disorganized children (Belsky & Fearon, 2002; 
NICHD Early Child Care Research Network, 2006). 
The question of whether attachment insecurity 
plays a causal role in the development of external- 
izing psychopathology is a vital one for the field, 
but there is clearly little case for causality if there is 
no association. With the sheer volume, range, and 
diversity of studies that have examined the associa- 
tion between attachment security and children’s 
externalizing behavior problems, it has become vir- 
tually impossible to provide a clear narrative 
account of the status of the evidence concerning 
this critical issue in developmental science. Given 
that sample variability around an effect of zero can 
lead to false positives, and sampling variability 
around a positive effect can lead to false negatives, 
the question of whether the existing evidence is 
consistent with positive association is critical for a 
full appreciation of the predictive significance of 
attachment for later externalizing behavior 
problems. Meta-analysis provides a_ structured, 
principled methodology for resolving—within 
limits—these essential scientific questions. In the 
current study, we analyzed over 60 independent 
studies that have conducted assessments of attach- 
ment security and insecurity using standardized 
observational tools and related them to measures of 
children’s externalizing behavior problems. In line 
with expectations derived from the literature, we 
set out to test several hypotheses, namely, that 
(a) attachment insecurity, in particular avoidant 
attachment, would be significantly associated with 
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externalizing behavior problems; (b) stronger 
effects would be found in low-socioeconomic-status 
(SES) samples than high-SES samples; (c) stronger 
associations would be found in boys than in girls; 
and (d) attachment disorganization would predict 
externalizing problems more strongly than avoid- 
ance or insecurity generally. We added to these a 
focus on whether effects of attachment-related varia- 
tion were moderated by age of assessment of exter- 
nalizing problems. The claim that early attachment 
has enduring—rather than merely transient—effects 
on development requires that the magnitude of such 
associations are not reduced to nil over time. Finally, 
we also examined a range of relevant methodologi- 
cal factors that might account for systematic 
between-study variability in effect sizes, including 
the method of assessment of attachment and the 
type and context of outcome measurement. 


Method 
Literature Search 


We systematically searched the electronic data- 
bases PsychInfo, Web of Science, MEDLINE, Sci- 
ence Citation Index Expanded, Social Sciences 
Citation Index, and Art & Humanities Citation 
Index with the key words externalizing, aggressi*, 
conduct, psychopathology, opposition*, compe- 
tence, social functioning, prosocial, antisocial, anti- 
social, behavior problem*, behaviour problem* in 
the title or abstract (the asterisk indicates that the 
search contained the word or word fragment). This 
large set was narrowed down by adding the con- 
straint that the papers must also contain the word 
attachment and child* or infan* in the title or 
abstract. This search returned over 1,200 articles in 
each of the databases. Two further separate search- 
narrowing strategies were adopted, which yielded 
two partially overlapping study sets. In one search, 
we targeted empirical studies by requiring the 
abstract to contain the words sample or N. In 
another, we required that at least one of the words 
secur*, avoidan*, resistan*, or disorgani* appeared 
in the title or abstract. In each case, this reduced 
the former search by around 60%. When these two 
sets of search results were merged, this resulted in 
856 candidate articles. These were subjected to 
abstract review in the first instance, from which a 
large number of clearly irrelevant articles were dis- 
carded (e.g., nonempirical papers, studies not 
involving children). A further 115 articles 
remained. These were examined individually by 
the authors according to criteria described next. 


Second, the reference lists of the collected empirical 
papers and influential reviews were searched for 
relevant studies (e.g., Kobak et al., 2005). Third, 
data sets available to the authors since they were in 
the public field (NICHD Study of Early Child Care 
and Youth Development) or part of their ongoing 
research (SCRIPT; Van Zeijl et al., 2006) were ana- 
lyzed with regard to the associations between 
attachment and externalizing behavior. 

Studies were included if they reported on the 
relation between attachment and externalizing or 
aggressive behavior in children 12 years of age or 
younger. Externalizing behavior was defined as 
aggression, oppositional problems, conduct prob- 
lems or hostility (either alone or in combination), as 
indicated in the descriptions provided in the 
method sections of the respective articles. Studies 
that did not differentiate between externalizing and 
internalizing problems (e.g., just total problems 
score of the CBCL) were excluded. Externalizing or 
aggressive behavior was assessed using observation 
(e.g., Matas, Arend, & Sroufe, 1978; Turner, 1991), 
questionnaires (CBCL, PBQ) or clinical interviews 
(e.g., Speltz, DeKlyen, & Greenberg, 1999), com- 
pleted by parents (e.g., Aviezer, Sagi, Resnick, & 
Gini, 2002), teachers (e.g., Egeland & Heister, 1995), 
or clinicians or trained observers (e.g., Turner, 
1991). We restricted the review to studies using 
observational measures of attachment, such as the 
SSP (Ainsworth et al., 1978), the Cassidy & Marvin 
Preschool Attachment system (Cassidy, Marvin, 
and The MacArthur Working Group on Attach- 
ment, 1989), the Attachment Q-Sort (AQS; Waters & 
Deane, 1985), and the Main and Cassidy system 
(Main & Cassidy, 1988). In cases where more than 
one attachment assessment was employed (e.g., the 
SSP followed by Cassidy & Marvin at a later age), 
the earliest attachment assessment was selected. 
We did not include studies that reported on repre- 
sentational measures of attachment (e.g., Attach- 
ment Story Completion Task; Verschueren & 
Marcoen, 1999). When intervention studies were 
identified, we only included data from the non- 
treated control sample (e.g., Lieberman, Weston, & 
Pawl, 1991). Only one study that met our entry cri- 
teria also reported on outcome data for father—child 
attachment security (Aviezer et al., 2002). As this 
would not allow a meaningful comparison of effect 
sizes between mother and father attachment, this 
study was excluded. The meta-analyses reported 
herein therefore only pertain to mother-child 
attachment. Also noteworthy is the fact that only 
four studies were based on samples from predomi- 
nantly minority-ethnic communities. 


Several studies presented data on (partly) over- 
lapping samples, such as Shaw and colleagues 
(Shaw, Owens, Vondra, Keenan, & Winslow, 1996; 
Shaw & Vondra, 1995) and the studies reported by 
Moss and colleagues (Moss, Bureau, Cyr, Mongeau, 
& St Laurent, 2004; Moss, Cyr, et al., 2004; Moss, 
Parent, Gosselin, & Rousseau, 1996). Because partic- 
ipants cannot be included in a meta-analysis more 
than once, the papers that reported on the largest 
groups of participants were included in our meta- 
analysis (e.g., Moss, Bureau, et al., 2004). In total, 
after excluding reports involving overlapping 
samples, we found 53 studies that yielded 69 inde- 
pendent samples that could be included in our 
meta-analyses, with sample sizes ranging from 26 
to 1,075 (see Table 1). In many cases, outcome sta- 
tistics were only presented for the avoidant and 
resistant classifications combined, or indeed for the 
resistant, avoidant, and disorganized cases com- 
bined. Consequently, we focused our primary anal- 
yses on the overall contrast between security and 
insecurity, with insecurity represented by the avoi- 
dant, resistant and (in the cases where disorganiza- 
tion had been coded) disorganized classifications. 
In these analyses, we also tested whether it made a 
difference to the overall effect size for security if 
disorganization had been coded. In addition, a 
number of studies used the AOS to measure attach- 
ment security, which does not yield data on the 
different subtypes of insecurity. As a result, these 
studies only appear in the meta-analyses involving 
the overall contrast between security and insecu- 
rity. Subsequently, we also extracted more focused 
contrasts targeting specific insecure categories from 
the smaller set of studies where these could be 
identified. The numbers of studies involved in 
these subanalyses are indicated in the text. 


Coding System 


We used a structured coding system for assess- 
ing the characteristics of the samples and their 
study designs. The measurement of attachment was 
coded straightforwardly, as all studies included 
one of several well-known attachment assessments 
(SSP, AQS, Preschool Attachment Assessment, Cas- 
sidy & Marvin; Main & Cassidy). In each case, the 
coder extracted effect sizes at the level of the indi- 
vidual attachment classification where possible (i.e., 
A, B, C, and D). In addition to a number of back- 
ground variables like year of publication and data 
source (journal, book chapter, unpublished data), 
we coded several important potential moderators 
related to the sample: gender (% male), SES 
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(high/middle vs. low), and clinical status (clinical- 
child, clinical-parent, nonclinical). Where the gen- 
der composition of the sample was not precisely 
reported we assumed a 50% split. Furthermore, 
when SES was not noted, a default of high/middle 
class was recorded (this occurred in five cases). 
Clinical status was recorded if either the parent or 
the target child was identified as having a clinical 
diagnosis or if they had been selected using a clini- 
cal cutoff score on a validated instrument. In addi- 
tion to the measure used to assess attachment, four 
other design characteristics were coded: (a) age of 
attachment assessment, (b) age of externalizing 
assessment, (c) type of outcome measure, and (d) 
observer or reporter of externalizing behavior. 
When measurements of externalizing problems at 
different points in time were reported, we selected 
the first measurement. When measurements at dif- 
ferent points in time were in some way merged 
(averaged or a trajectory extracted), we recorded 
the midpoint of the range as the age of the external- 
izing assessment (e.g., Keller, Spieker, & Gilchrist, 
2005). To assess intercoder reliability, 20 randomly 
selected studies were coded by two coders. The 
agreement between the coders across the moderator 
variables was 97% (correlations between continuous 
moderators were > .95). 


Meta-Analytic Procedures 


A number of studies reported results separately 
for boys and girls and four studies reported on 
samples involving only boys or only girls. In these 
cases, we calculated separate effect sizes for each 
gender, and the subsamples were treated as inde- 
pendent outcomes in the analyses. When multiple 
measures of aggression or externalizing behaviors 
were used within one study (e.g., Solomon, George, 
& De Jong, 1995), we selected the outcome for 
externalizing behavior for the primary set of stud- 
ies. In a separate set of meta-analyses, we tested 
whether outcomes were different when aggression 
outcomes were selected (see the following). 


Statistical Analyses 


Four sets of meta-analyses were conducted, one 
for the relation between attachment insecurity and 
externalizing or aggressive behavior, one for the 
relation between avoidance and externalizing or 
aggressive behavior, one for the relation between 
resistance and externalizing or aggressive behavior, 
and one for the relation between attachment 
disorganization and externalizing or aggressive 
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Table 1 


Sample Characteristics for Primary Set of Studies 


Source 


Anan & Barnett (1999) 

Aviezer et al. (2002) 

Bakermans-Kranenburg & 
van IJzendoorn (2006) 


Bates & Bayles (1988) 
Booth et al. (1991) 


Booth et al. (1994) 
Burgess et al. (2003) 
Carlson (1998) 


Cicchetti et al. (1998) 
Cohn (1990) 


DeMulder et al. (2000) 


DeVito & Hopkins (2001) 
Edwards et al. (2006) 


Egeland & Heister (1995) 


Fagot & Leve (1998) 

R. P. Fearon, unpublished data 
Gilliom et al. (2002) 

Goldberg et al. (1995) 


Goldberg et al. (1990) 
Greenberg et al. (1991) 
Howes et al. (1994) 

Hubbs Tait et al. (1994) 
Keller et al. (2005) 

Klein Velderman et al. (2006) 
Lewis et al. (1984) 


Lieberman et al. (1991) 
Lyons Ruth et al. (1993) 
Madigan et al. (2007);. 
Marchand & Hock (1998) 
Matas et al. (1978) 

Moss, Cyr, et al. (2004) 
Munson et al. (2001) 
NICHD 


F. D. Pannebakker, unpublished data 
Perez Corres (2006) 

Pierrehumbert et al. (2000) 

Radke Yarrow et al. (1995) 


Subsample description 


Boys subsample 


Girls subsample 
Boys subsample 
Girls subsample 
High-risk subsample 
Low-risk subsample 


Minnesota study: Effect size 
for D versus non-D only 


Boys subsample 
Girls subsample 
Boys subsample 
Girls subsample 


Clinical fathers subsample 

Nonclinical fathers subsample 

Minnesota study: B versus 
non-B effect size 


Twin sample 


Cystic fibrosis sample 
Coronary heart disease sample 
Nonclinical sample 


ODD + Controls 


Boys subsample modified SSP 
Girls subsample modified SSP 
Intervention— control sample only 


Boys high-SES subsample 
Boys low-SES subsample 
Girls high-SES subsample 
Girls low-SES subsample 


Attachment 
measure 


CassMarv 
SSP 
SSP 


SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 


AQS 
SSP 
SSP 

AQS 

AQS 

PAA 
SSP 
SSP 
SSP 


SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
CassMarv 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
AQS 
SSP 
CassMarv 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 
SSP 


Outcome 


CBCL 
CBCL 
CBCL 


CBCL 
CBCL 
CBCL 
Obs 
Obs 
CBCL 
CBCL 
CBCL 


CBCL 
Other 
Other 
Other 
Other 
CBCL 
CBCL 
CBCL 
CBCL 


CBCL 
CBCL 
CBCL 
CBCL 
CBCL 
CBCL 
Other 
Diag 
Other 
CBCL 
CBCL 
CBCL 
CBCL 
CBCL 
Obs 
Other 
CBCL 
CBCL 
Obs 
Other 
CBCL 
CBCL 
CBCL 
CBCL 
CBCL 
CBCL 
CBCL 
CBCL 
Diag 


140 


128 


136 


189 


169 


220 
101 
490 
460 


115 
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Table 1 
Continued 
Attachment 
Source Subsample description measure Outcome N 
Rothbaum et al. (1995) SSP CBCL 32 
Schmidt et al. (2002) AQS CBCL 49 
C Schuengel, M. J. Bakermans-Kranenburg, SSP CBCL 38 
& M. H. van IJzendoorn, unpublished data 
Seifer et al. (2004) SSP CBCL 732 
Shaw et al. (1996) SSP CBCL 77 
Smeekens et al. (2007) SSP CBCL 105 
Solomon et al. (1995) MC Other 40 
Speltz et al. (1990) CassMarv Diag 50 
Speltz et al. (1999) CassMarv Diag 160 
Stams et al. (2002) SSP CBCL 155 
Suess et al. (1992) SSP Obs 35 
Turner (1991) Boys subsample CassMarv Obs 18 
Girls subsample CassMarv Obs 22 
van IJzendoorn et al. (1992) SSP Other 68 
Van Zeijl et al. (2006) 1-year SSP boys CassMarv CBCL 25 
1-year SSP girls CassMarv CBCL 18 
2-year SSP boys CassMarv CBCL 28 
2-year SSP girls CassMarv CBCL 10 
3-year SSP boys CassMarv CBCL 18 
3-year SSP girls CassMarv CBCL 16 
Vondra et al. (2001) SSP CBCL 165 
Weiss & Seed (2002) AQS CBCL 110 
Wood et al. (2004) AQS CBCL 37 


Note. AQS = Waters and Deane (1985) Attachment Q-Set; CassMarv = Cassidy and Marvin/MacArthur Preschool Attachment Coding 
System; SES = socioeconomic status; SSP = Strange Situation procedure; PAA = Crittenden Preschool Attachment Assessment; 
MC = Main and Cassidy Age 6 Scoring System; Obs = externalizing directly observed; CBCL = Child Behavior Checklist; 


Other = other externalizing questionnaire; Diag = clinical diagnosis. 


behavior. The meta-analyses were performed using 
the Comprehensive Meta-Analysis (CMA) program 
(Version 2; Borenstein, Rothstein, & Cohen, 2005). 
For each study, an effect size (d) was calculated as 
the standardized difference between the two perti- 
nent groups (e.g., secure vs. insecure). In those 
cases where continuous attachment scores were 
correlated with externalizing scores (e.g., when the 
study reported on the AQS), we recomputed the 
statistic into Cohen’s d (see Mullen, 1989; Mullen & 
Rosenthal, 1985, chap. 6, for the formulae for trans- 
formation of various statistics into Cohen’s 4d). 
Effect sizes indicating a positive relation between 
externalizing behavior and insecurity, avoidance, 
and disorganization, respectively (higher levels of 
externalizing behavior in the insecure, avoidant, or 
disorganized group compared to the reference 
group), were given a positive sign. Thus, a positive 
combined effect for the set of studies comparing 
disorganized children with secure children on 
externalizing behaviors would mean that across 
these studies the level of externalizing behaviors in 


disorganized children was higher than in secure 
children. In the main analyses, we compared exter- 
nalizing behaviors of the children in each attach- 
ment classification with all other classifications 
combined. In an additional analysis on a smaller 
set of studies with pertinent data, we also com- 
pared each classification with the secure classifica- 
tion as the most ‘pure’ reference category. 

Using CMA, combined effect sizes were com- 
puted. Significance tests and moderator analyses 
were performed through fixed or random effects 
models, depending on the homogeneity of the 
study outcomes. Fixed effects models are based 
on the assumption that effect sizes observed in a 
study estimate the corresponding population 
effect with random error that stems only from 
the chance factors associated with subject-level 
sampling error in that study (Lipsey & Wilson, 
2001; Rosenthal, 1991). This assumption is not 
made in random effects models (Hedges & Olkin, 
1985). Random effects models allow for the possi- 
bility that there are random differences between 
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studies that are associated with variations in 
procedures, measures, and settings that go 
beyond subject-level sampling error and _ thus 
point to different study populations (Lipsey & 
Wilson, 2001). To test the homogeneity of the 
overall and specific sets of effect sizes, we com- 
puted Q statistics (Borenstein et al., 2005). In 
addition, we computed 95% confidence intervals 
(CIs) around the point estimate of each set of 
effect sizes. When the set was homogeneous, CIs 
were based on fixed estimates. In cases where 
there was heterogeneity across studies, we based 
CIs on random estimates. Q statistics and p val- 
ues were also computed to assess differences 
between combined effect sizes for specific subsets 
of studies grouped by moderators. Again, fixed 
effects model tests were used in the case of 
homogeneous sets of outcomes, and more conser- 
vative random effects model tests were used in 
the case of heterogeneous outcomes. In the pres- 
ent study, random models were tested unless 
otherwise specified. Contrasts were only tested 
when at least two of the subsets consisted of at 
least four studies (Bakermans-Kranenburg, van 
Jzendoorn, & Juffer, 2003). 

When the children in two sets of studies (par- 
tially) overlapped (e.g., some studies reported 
both aggression and _ externalizing, and we 
wanted to compare the combined effects for 
aggression and externalizing), it was impossible 
to compare directly effect sizes across these sets. 
We computed 85% CIs for the point estimates of 
the combined effect sizes in the two sets: Non- 
overlapping 85% CIs indicate a significant differ- 
ence between combined effect sizes (Bakermans- 
Kranenburg et al., 2003). This approach of com- 
paring 85% CIs served as a conservative signifi- 
cance test (Goldstein & Healy, 1995). We used 
the “trim-and-fill’ method (Duval & Tweedie, 
2000a, 2000b) to calculate the effect of potential 
data censoring (or publication bias) on the out- 
come of the meta-analyses. Using this method, a 
funnel plot is constructed of each study’s effect 
size against the sample size or the standard error 
(usually plotted as 1/SE, or precision). It is 
expected that this plot has the shape of a funnel 
because studies with smaller sample sizes (larger 
standard errors) have increasingly larger variation 
in estimates of their effect size as random varia- 
tion becomes increasingly influential, whereas 
studies with larger sample sizes have smaller 
variation in effect sizes (Duval & Tweedie, 2000b; 
Sutton, Duval, Tweedie, Abrams, & Jones, 2000). 
The plots should only be shaped like a funnel if 


no data censoring is present. However, as smaller 
or nonsignificant studies are less likely to be 
published (the “file-drawer’’ problem; Mullen, 
1989), studies in the bottom left-hand corner of 
the plot are often omitted (Sutton et al., 2000). In 
our meta-analyses, the k right-most studies con- 
sidered to be symmetrically unmatched were 
trimmed. The trimmed studies can then be 
replaced and their missing counterparts imputed 
or “filled” as mirror images of the trimmed out- 
comes. This then allows for the computation of 
an adjusted overall effect size and CI (Gilbody, 
Song, Eastwood, & Sutton, 2000; Sutton et al., 
2000). 

For each meta-analysis, we also calculated the 
number of studies with average sample size and 
nonsignificant outcome that would be required to 
bring the combined effect size of the meta-analysis 
to a nonsignificant level (fail-safe number; Mullen, 
1989). Rosenthal (1991, p. 106) suggested that a fail- 
safe number of more than 5k + 10 (k = number of 
studies included) may be considered a general 
criterion for robustness. 

For each study, Fisher’s Z scores were computed 
as well-distributed equivalents for the effect size d, 
and the Z scores were standardized to test for out- 
liers. No outliers (standardized Z values smaller 
than —3.29 or larger than 3.29; Tabachnik & Fidell, 
2001) were found for study effect sizes. 


Results 


Is Insecure Attachment Associated With More 
Externalizing Problems? 


The first set of meta-analyses concerned the dif- 
ference in externalizing behaviors between children 
rated as secure versus children classified as inse- 
cure. In 69 studies including N = 5,947 participants, 
the association between attachment security and 
externalizing behaviors was reported. Any study 
assessing attachment and_ externalizing was 
included in this total set, regardless of type of mea- 
sures used. If disorganized attachment was 
assessed, this category was included in the insecure 
group. In this overall set, we found a significant 
combined effect size of d = 0.31 (see Table 2). Chil- 
dren rated as insecure showed higher levels of 
externalizing behaviors than children rated as 
secure. The effect size was modest but robust, 
as more than 1,700 studies with null results (fail- 
safe number) would be needed to reduce this effect 
to nonsignificance. Further support for the absence 


Table 2 
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Insecure Attachment and Externalizing Behavior: Total Set and Set of SSP Studies 


k N d 

Total set 69 5,947 0.31** 
Clinical 

Nonclinical 56 4,812 0.26" 

Clinical 13 1,135 0.49** 
Gender 

Boys 14 1,210 (0:35** 

Girls 12 907 -0.03 

Mixed 43 3,830 0.36** 
SES 

Low 14 1,801 0.25** 

Middle/high 55 4,146 0.314" 
Measure 

SSP 43 4,488 0.18** 

AQS 7 464 0.70** 

CassMarvin 12 708 037" 

Other 7 287 0.39%* 
Observer ext 

Mother 44 4,129 0.22** 

Teacher 10 922 0.30** 

Observed vf 211 0.58** 

Other 6 425 0.62** 

Combined 2 260 0.45** 
SSP studies 
All SSP studies 43 4,488 0.18** 
Clinical 

Nonclinical 36 3,899 0.22" 

Clinical 7 589 0.21* 
Gender 

Boys 6 836 0.18* 

Girls 6 753 —0.06 

Mixed 31 2,899 0.24** 
SES 

Low 12 1,635 0.22** 

Middle/high 31 2,853 0.19** 
Observer ext 

Mother 31 3,499 0.13** 

Teacher 4 463 0.22* 

Observed 5 171 0.61** 

Other 1 95 0.32 

Combined 2 260 0.45** 


Confidence Homogeneity Contrast Contrast 
interval 95% Q Q° P 
0.23, 0.40 135.18** 
5.48 02 
0.17, 0.35 89.06** 
0.32, 0.66 29.98** 
8.49 01 
0.17, 0.54 32.41** 
—0.16, 0.11 13.93 
0.26, 0.46 69.79** 
0.05 82 
0.15, 0.35 15.49 
0.21, 0.41 119.69** 
14.49 < .01 
0.12, 0.24 57.31 
0.51, 0.90 5.57 
0.16, 0.57 32.18** 
0.14, 0.64 10.93 
10.27° 02 
0.12, 0.32 72.07" 
0.17, 0.44 15.72 
0.30, 0.86 4.12 
0.35, 0.89 15.83** 
0.20, 0.71 2.21 
0.12, 0.24 57.31 
0.03 86 
0.13, 0.31 55.33* 
0.04, 0.38 1.83 
13.08 < .01 
0.04, 0.32 4.27 
—0.21, 0.09 8.52 
0.17, 0.32 31.44 
0.90 34 
0.12, 0.32 11.47 
0.09, 0.29 44.87* 
8.91° 01 
0.06, 0.20 39.35 
0.03, 0.40 0.79 
0.29, 0.92 0.80 
—0.10, 0.73 
0.20, 0.71 2.21 


Note. SES = socioeconomic status; SSP = Strange Situation procedure; AQS = Attachment Q-Sort; CassMarvin = Cassidy and 


Marvin/MacArthur Preschool Attachment Coding System. 
“Subgroup with k < 4 excluded from contrast. 
*p < 05. *p < .01. 


of the file-drawer problem was evident through 
the trim-and-fill approach, showing that only five 
studies had to be trimmed and filled, with a result- 
ing significant combined effect size of d = 0.27 (95% 
CI: 0.18, 0.36). 

As the total set of studies for secure versus inse- 
cure attachment was heterogeneous (see Table 3), 


we looked for significant moderators that might 
account for between-study variability in outcome. 
Gender appeared to be a significant moderator (see 
Table 2). In samples with only girls, the combined 
effect size was d = —0.03 (ns), whereas in the sam- 
ples with only boys and in the mixed samples (i.e., 
with boys and girls) the combined effect sizes were 
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Table 3 
Avoidant Attachment and Externalizing Behavior: Total Set and Set of SSP Studies 


Confidence Homogeneity Contrast Contrast 
k N d interval 95% Q Q p 
Total set 34 3,675 0.12** 0.03, 0.21 40.54 
Clinical 0.93 33 
Nonclinical 28 3,273 0.10* 0.01, 0.20 35.62 
Clinical 6 402 0.22* 0.01, 0.43 3.98 
Gender 1.24 54 
Boys 9 890 0.19* 0.03, 0.36 5.32 
Girls 7 763 0.13 —0.09, 0.34 8.45 
Mixed 18 2,022 0.08 —0.04, 0.20 25.53 
SES 2.42 12 
Low 5 1,001 —0.01 —0.20, 0.17 6.81 
Middle/high 29 2,674 0.15** 0.06, 0.25 31.31 
Measure 0.00* 98 
SSP 25 3,054 0.13" 0.03, 0.23 26.01 
CassMarvin 7 523 0.13 -0.11, 0.37 12.78* 
Other 2 98 —0.20 —0.69, 0.28 0.01 
SSP studies 
All SSP studies 25 3,054 0:13" 0.03, 0.23 26.01 
Gender 0.03 98 
Boys 5 647 0.12 —0.08, 0.33 1.09 
Girls 6 753 0.16 —0.06, 0.38 1.77 
Mixed 14 1,654 O:15* 0.01, 0.33 23.03* 
SES 2.95 10 
Low 5 1,001 —0.01 —0.20, 0.17 6.81 
Middle/high 20 2,053 0.18** 0.07, 0.29 16.25 


Note. SES = socioeconomic status; SSP = Strange Situation procedure; CassMarvin = Cassidy and Marvin/MacArthur Preschool 


Attachment Coding System. 
“Subgroups with k < 4 excluded from contrast. 
*p < .05. *p < .01. 


significant, d = 0.35 and d = 0.36, respectively, and 
significantly different from the null effect in the 
girls-only samples. Within the mixed samples, the 
percentage of males in the study tended to be 
positively related to the magnitude of the attach- 
ment-externalizing problems effect size (slope = 
.013, p = .11). Clinical samples also showed a signif- 
icantly larger combined effect size (d = 0.49) than 
nonclinical samples (d= 0.26). This moderator 
effect was not dependent on gender differences as 
only two of the clinical samples consisted of boys 
only (Greenberg, Speltz, Deklyen, & Endriga, 1991; 
Speltz et al., 1999). Contrary to expectations, SES 
was not a significant moderator (see Table 2). 

The type of assessment of externalizing behav- 
iors and of attachment appeared to make a differ- 
ence to the effect sizes. When externalizing 
behavior was observed directly (seven studies) or 
was indexed by a clinical diagnosis (six studies), 
the combined effect sizes were larger than in cases 
where a parent or teacher rated the level of exter- 
nalizing behaviors. The group of studies based on 


observations of externalizing behavior was homo- 
geneous. Its combined effect size of d = 0.58 was 
therefore an adequate estimate of the average effect, 
which amounted to a quite strong association 
between attachment security and _ externalizing 
behavior. The way in which attachment security 
was assessed also made a significant difference. In 
particular, studies conducted with the AQS showed 
the largest effect sizes (d = 0.70), whereas studies 
using the SSP yielded the lowest combined effect 
size (d = 0.18), though this latter effect was never- 
theless significant. Because the different attachment 
measures are typically conducted at different ages, 
we also conducted a meta-regression analysis with 
age at the assessment of attachment as a predictor. 
As expected, the regression was significant (slope = 
.006, p = .01). Notably though, the effect of age was 
not significant within the SSP, AQS, or Cassidy and 
Marvin studies, suggesting that age and attachment 
measure were confounded. Furthermore, the 
regression with age did not appear to result solely 
from the larger effects associated with the AQS, as 


the same regression was significant when AQS 
studies were excluded (slope = .005, p = .03). It is 
also noteworthy that the overall effect size for secu- 
rity did not vary as a function of whether or not 
disorganization had been coded (Q = 0.10, p = .78). 
Note that this latter analysis excludes AQS studies 
by definition, as this procedure does not yield a 
score or classification for disorganized attachment. 

Because the SSP is considered to be the gold stan- 
dard for measuring attachment security, and the set 
of SSP studies was sufficiently large (k = 43), we 
decided to conduct complementary analyses for 
secure versus insecure attachment on this subset (see 
Table 2). In this homogeneous set of studies, we did 
not find a difference in combined effect size between 
clinical and nonclinical samples. The difference 
between samples with only girls versus only boys or 
mixed samples, however, was significant again, with 
all-female samples showing no association between 
attachment security and externalizing problems 
(d = —0.06). Also, we confirmed the larger combined 
effect size for those SSP studies that included obser- 
vational measures of externalizing (d = 0.61) com- 
pared to the other types of assessment. 

Interestingly, among the SSP studies the age at 
which the assessment of externalizing behavior was 
taken yielded a significant regression weight, with a 
slope of .002 (p = .02), indicating that the association 
between attachment security and _ externalizing 
became stronger with age. Because the SSPs are 
usually conducted within a small age window of 12- 
18 months, this significant slope suggested that the 
prediction of externalizing from attachment security 
was better with later—not earlier—assessments of 
externalizing, which is surprising given the longer 
interval between assessments in these studies. 


Is Insecure-Avoidant Attachment Associated With More 
Externalizing Problems? 


In 34 studies involving N = 3,675 participants, the 
insecure-avoidant attachment classifications were 
differentiated from the other classifications, and in 
this subset of studies the combined effect size was 
only d = 0.12, which was significant but small in 
magnitude (see Table 3). Insecure-avoidantly 
attached children displayed somewhat more exter- 
nalizing behaviors than comparisons. With one 
study trimmed and filled the resulting significant 
effect size was d = 0.11, but the fail-safe number of 
studies needed to bring the effect down below 
significance was only 24. Because this number is 
below the Rosenthal (1991) criterion of 5k + 10, this 
outcome should be considered with caution. No 
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significant moderator effects were found. The effect 
did not vary according to whether or not disorgani- 
zation had been coded. Within the SSP subset of 25 
studies, the combined effect size for insecure- 
avoidant attachment was d = 0.13, and the modera- 
tor analyses on this subset converged with the 
analyses on the total set of studies for avoidance (see 
Table 3 for those contrasts that could be tested). 


Is Insecure-Resistant Attachment Associated With More 
Externalizing Problems? 


In 35 studies involving N = 3,568 participants, 
the insecure-resistant attachment classifications 
were differentiated from the other classifications. In 
this subset of studies, the combined effect size was 
not significant, d = 0.11 (see Table 4), and no signif- 
icant moderator effects were found. Within the SSP 
subset of 24 studies, the combined effect size for 
insecure-resistant attachment was only d = 0.05, 
and the contrasts on this subset showed no signifi- 
cant moderators (see Table 4 for those contrasts 
that could be tested). 


Is Disorganized Attachment Associated With More 
Externalizing Problems? 


In 34 studies including N = 3,778 participants, a 
significant combined effect size of d= 0.34 (see 
Table 5) was found for the association between dis- 
organized attachment and externalizing behavior. 
As expected, disorganized attachment was associ- 
ated with a higher risk for externalizing behavior 
later in childhood. However, eight studies had to be 
trimmed and filled, with a recomputed significant 
combined effect size of d = 0.18 (95% CI: 0.01, 0.34). 
The fail-safe number amounted to k = 407, which 
was above the Rosenthal criterion, suggesting that 
the file-drawer problem was not responsible for the 
association found in the current set of studies. 

The set of studies was heterogeneous, and mod- 
erator analyses showed that gender was a signifi- 
cant moderator (see Table 5). Remarkably, in the 
samples with females only the association between 
disorganized attachment and externalizing behav- 
iors was significantly different from the samples 
with only boys or with mixed gender, and in fact, 
the relation was negative; that is, disorganized 
attachment was associated with less externalizing 
behavior. However, the combined effect size of the 
six female samples (N= 702) was modest, 
d = —0.20. Clinical status, SES, or type of assess- 
ment (for both SSP and externalizing behavior) 
did not appear to moderate the association 
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Table 4 


Resistant Attachment and Externalizing Behavior: Total Set and Set of SSP Studies 


k N d 

Total set 85 3,568 0.11 
Clinical 

Nonclinical 29 3,165 0.06 

Clinical 6 403 0.30 
Gender 

Boys 9 883 0.16 

Girls 10 809 0.16 

Mixed 16 1,876 0.10 
SES 

Low 3 857 0.04 

Middle/high 32 2711 0.11 
Measure 

SSP 24 2,910 0.05 

CassMarvin 9 559 0.25* 

Other 2 99 0.39 
Observer ext 

Mother 27 2,831 0.08 

Teacher 3 334 0.21 

Observed 1 48 -0.07 

Other 3 250 0.24 

Combined 1 105 0.10 
SSP studies 
All SSP studies 24 2,910 0.05 
Gender 

Boys 5 637 0.11 

Girls 7 766 0.17 

Mixed 12 1,507 0.01 
SES 

Low 3 857 0.04 

Middle/high 21 2,053 0.05 


Confidence Homogeneity Contrast Contrast 
interval 95% Q Q* p 
—0.04, 0.26 66.32** 
1.36 24 
—0.10, 0.23 48.76** 
—0.05, 0.64 14.27* 
0.11 95 
—0.02, 0.34 7.47 
—0.20, 0.52 22.88** 
—0.12, 0.32 35.45** 
—0.17, 0.24 0.66 
—0.06, 0.28 65.17" 
0.97* 33 
—0.13, 0.24 35.54* 
0.05, 0.45 12.90 
—0.23, 1.01 13.24** 
—0.12, 0.28 54.62** 
—0.29, 0.71 7.14* 
—0.66, 0.52 
—0.02, 0.49 1.03 
—0.29, 0.49 
—0.13, 0.24 35.54* 
0.56 75 
—0.14, 0.36 4.17 
—0.19, 0.53 16.59* 
—0.13, 0.14 14.03 
—0.17, 0.24 0.66 
—0.14, 0.23 34.87* 


Note. SES = socioeconomic status; SSP = Strange Situation procedure; CassMarvin = Cassidy and Marvin/MacArthur Preschool 


Attachment Coding System. 
“Subgroups with k < 4 excluded from contrast. 
*p < .05. *p < .01. 


between disorganized attachment and externalizing 
behavior. 

In the set of 24 SSP studies with N = 3,161 partic- 
ipants, we found a significant combined effect size 
of d =0.27, which was similar to the effect size 
computed for the total set. No other significant 
moderators were found in this set (see Table 5 for 
those contrasts that could be tested). 


Additional Analyses 


The core set of studies on externalizing included 
assessments of externalizing as well as of aggres- 
sive behavior in the case of studies that did not 
present data on externalizing problems. In order to 
examine whether the more focused aggression 
studies would result in higher effect sizes, we 


decided to conduct two sets of meta-analyses, one 
for studies with data on externalizing and one for 
studies presenting aggression data. These two sets 
of studies partially overlapped (as some studies 
reported both), and it was therefore impossible to 
compare directly effect sizes across these sets (see 
the Method section). We computed 85% CIs for the 
point estimates of the combined effect sizes and 
compared these intervals across the two sets of 
studies: Nonoverlapping 85% CIs indicated a sig- 
nificant difference in combined effect sizes (Baker- 
mans-Kranenburg et al., 2003). For the association 
between secure versus insecure attachment and 
externalizing behavior (k = 65), a combined effect 
size of d= 0.32 (p< .01; 85% CI: 0.26, 0.38) was 
found. The comparable combined effect size for the 
aggression outcomes (k = 32) was d = 0.24 (p < .01; 


Table 5 
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Disorganized Attachment and Externalizing Behavior: Total Set and Set of SSP Studies 


k N d 

Total set 34 3,778 0.34** 
Clinical 

Nonclinical af 3,184 0.30** 

Clinical 7 594 0.43** 
Gender 

Boys 8 839 0.35* 

Girls 6 702 —0.20* 

Mixed 20 2,237 0.44** 
SES 

Low 9 1,266 0.44** 

Middle/high 25 2,512 O:31** 
Measure 

SSP 24 3,161 0.27** 

CassMarvin? 9 573 0.50** 

Other 1 44 1.10** 
Observer ext 

Mother 24 2,758 0.20* 

Teacher 4 415 0.48* 

Observed 0 0 

Other 4 345 0.62** 

Combined 2 260 0.61* 
SSP studies 
All SSP studies 24 3,161 0.27** 
Clinical 

Nonclinical 20 2,817 0.29** 

Clinical 4 344 0.26* 
Gender 

Boys 3 568 0.12 

Girls 4 669 —0.24* 

Mixed 17 1,924 0.39%" 
SES 

Low 9 1,266 0.44** 

Middle/high 15 1,895 0.17 


Confidence Homogeneity Contrast Contrast 
interval 95% Q Q° P 
0.18, 0.50 99.66** 
0.75 39 
0.12, 0.49 83.00** 
0.26, 0.61 11.91 
6.58 04 
0.03, 0.66 20.84** 
—0.39, —0.01 5.62 
0.26, 0.61 42.82** 
0.42 52 
0.28, 0.60 13.42 
0.12, 0.50 80.22** 
132" 25 
0.10, 0.45 69.00** 
0.16, 0.84 19.41* 
0.41, 1.79 
5.78° 06 
0.02, 0.39 52.94** 
0.06, 0.91 11.73** 
0.39, 0.84 5.32 
0.08, 1.13 Toor" 
0.10, 0.45 69.00** 
0.08 77 
0.09, 0.48 67.25** 
0.03, 0.38 155 
10.99% < .01 
—0.12, 0.36 5.17 
—0.44, —0.05 1.84 
0.22, 0.56 31.38** 
2.15 14 
0.28, 0.60 13.42 
—0.03, 0.38 43.81** 


Note. SES = socioeconomic status; SSP = Strange Situation procedure; CassMarvin = Cassidy and Marvin/MacArthur Preschool 


Attachment Coding System. 


Subgroup with k < 4 excluded from contrast. Insecure-other included in disorganized. 


*p < 05. *p < .01. 


85% CI: 0.13, 0.35). For the association between avo- 
idant versus nonavoidant attachments and external- 
izing (k = 33), the combined effects size was 
d=0.12 (p < .01; 85% CI: 0.06, 0.21), and for the 
aggression outcomes (k = 20) the combined effect 
size amounted to d= 0.28 (p< .05; 85% CI: 0.08, 
0.49). For the association between resistant versus 
nonresistant attachments and externalizing (k = 34), 
the combined effects size was d = 0.10 (p > .05; 85% 
CI: —0.01, 0.21), and for the aggression outcomes 
(k = 22) the combined effect size was d= 0.05 
(p > .05; 85% CI: —0.10, 0.21). Finally, for the associ- 
ation between disorganized attachments and exter- 
nalizing (k = 33), the combined effect size was 


d = 0.37 (p < .01; 85% CI: 0.25, 0.49), whereas for 
the aggression outcomes (k = 16) this combined 
effect size was d=0.12 (p> .05; 85% Cl: —0.06, 
0.30). The 85% CIs did overlap for each of these 
comparisons, indicating that study outcomes with 
externalizing behavior or with aggression did not 
result in significantly different effect sizes. 

Because the various comparisons (secure vs. 
insecure, avoidant vs. nonavoidant, and disorga- 
nized vs. nondisorganized) were based on varying 
numbers of studies and participants, we also 
selected a core set of 19 studies that provided data 
on all four comparisons. For the association 
between attachment security and externalizing, the 
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combined effect size was d = 0.27 (p < .01; 85% CI: 
0.15, 0.39). For avoidance, this combined effect size 
amounted to d = 0.06 (p > .05; 85% CI: —0.01, 0.13), 
for resistance it was d = 0.11 (p < .05; 85% CI: 0.03, 
0.19), and for disorganization the combined effect 
size was d = 0.29 (p < .01; 85% CI: 0.13, 0.45). The 
85% Cls of the combined effect sizes for attachment 
security and disorganization did not overlap with 
the 85% CI of the combined effect size for avoidance, 
but for the other comparisons the 85% CIs over- 
lapped. Resistant attachment did not show a differ- 
ent combined effect size compared to all other 
attachment classifications. Insecure and disorga- 
nized attachments thus implicate a higher risk for 
externalizing behavior than avoidant attachment. 
We also compared each of the nonsecure classifica- 
tions with the secure classification. In a core set of 18 
studies that provided data on all three comparisons, 
the combined effect size for the association between 
avoidance versus security and externalizing was 
d =0.12 (p < .05; 85% CI: 0.04, 0.20). For resistant 
versus secure attachment, it was d = 0.19 (p < .01; 
85% CI: 0.11, 0.28), and for disorganized versus 
secure attachment, the combined effect size was 
d = 0.27 (p < .01; 85% CI: 0.13, 0.41). For all three 
comparisons, the 85% CIs overlapped, implying that 
the effects of the various types of insecurity showed 
similar associations with externalizing behavior. 


Discussion 


Since Bowlby’s earliest work on attachment and 
separation, there have been persistent suggestions 
in the literature that attachment insecurity may play 
an important role in the development of aggression 
and antisocial behavior (Bowlby, 1944; Lewis et al., 
1984; Lyons Ruth et al., 1993; Renken et al., 1989; 
van IJzendoorn, 1997). The body of research that 
subsequently tested this association is impressive 
in its sheer size. However, despite an extensive 
accumulation of data, a clear view on the empirical 
standing of this important hypothesis has been 
elusive. Apparently contradictory findings, nonre- 
plications, and a diversity of study designs and 
sample sizes have created a body of work that is 
difficult to integrate coherently in narrative reviews. 

The central question we thus posed in this meta- 
analysis was whether attachment insecurity was 
associated with externalizing behaviors across all 
the studies conducted to date. The results showed 
quite clearly that the answer to this question is a 
firm yes. Drawing from data on nearly 6,000 chil- 
dren tested in standardized observational assess- 


ments of mother-child attachment security, the 
average effect size for the contrast between secure 
and insecure children was d = 0.31 (95% CI: 0.23, 
0.40). Over 1,700 studies of average sample size 
with null results would need to be added to the 
database to reduce this effect to nonsignificance. 
For clinical samples, the average effect size 
amounted to d = 0.49 (95% CI: 0.32, 0.66). On the 
face of it, these robust findings lend direct support 
to the notion that attachment plays a significant 
role in the evolution of children’s behavior prob- 
lems, for typically developing children as well as 
for clinical groups. 

It should be noted that for meta-analytic results 
the evaluation of combined effect sizes in terms of 
absolute magnitude is problematic (McCartney & 
Rosenthal, 2000). It is arguably more meaningful to 
consider the global association between insecurity 
and externalizing problems in the context of other 
studies examining similar phenomena and employ- 
ing similar methodologies (McCartney & Rosenthal, 
2000). In that respect, the combined effect size of 
d =0.31 reported here is of similar magnitude to 
meta-analytic results concerning the association 
between aggression and hostile attributional biases 
(d = 0.35; see Orobio de Castro, Veerman, Koops, 
Bosch, & Monshouwer, 2002) or resting heart rate 
(d = —0.38, Lorber, 2004) and substantially higher 
than that between aggression and basal cortisol 
(d = —0.10; see Alink et al., 2008). The combined 
effect found in this analysis gains even greater sig- 
nificance in light of the fact that a majority of the 
studies included in the analysis were longitudinal 
investigations, where independent and dependent 
variables were measured often several years apart 
(with an intervening period of 25 months on aver- 
age). 

Three perhaps obvious additional points about 
the effects should be made at the outset. First, there 
were so few outcome studies that examined father- 
child attachment security that we were unable to 
include them in this meta-analysis. There is clearly 
an urgent need for further research into the contri- 
bution of father—child attachment security and inse- 
curity to children’s development. Second, the 
effects reported in this meta-analysis reflect statisti- 
cal association, not causation and—although they 
provide evidence relevant to efforts to determine 
causality and its mechanisms—alone they are mute 
on this issue. Third, the effects are uncorrected for 
the influence of relevant third variables. Controls 
for these could reduce or increase the magnitude of 
the global meta-analytic effects. Furthermore, the 
effects represent an average across a potentially 


large number of moderating relationships that 
could amplify or attenuate the association between 
attachment and externalizing problems (e.g., Belsky 
& Fearon, 2002; NICHD Early Child Care Research 
Network, 2006). Related to this point, the associa- 
tion for children from nonclinical populations was 
highly heterogeneous, indicating large between- 
study differences in effect size, which could have 
resulted from a number of methodological factors, 
such as the composition of the populations studied, 
the length of the follow-up period or the measure- 
ment strategies that were adopted. Indeed, the 
larger effect found in clinical samples (d = 0.49) 
illustrates this point, and at the same time demon- 
strates the significance of attachment for clinical 
groups. 

Within clear constraints, the analyses reported 
in this study were able to consider the role of a 
number of other potentially important moderators 
that have been highlighted in the literature. Cen- 
tral among these were SES (with low-risk samples 
anticipated to yield larger effects), gender (inse- 
cure boys expected to show more behavior prob- 
lems), and age of outcome (with effects expected 
to persist over time). In contrast to our expecta- 
tions, the magnitude of the association between 
attachment and behavior problems was relatively 
consistent across high- and low-SES samples 
(d = 0.25 vs. d = 0.31, respectively). SES represents 
a rather blunt approximation of a number of 
important proximal psychosocial risk processes 
that may be more clearly implicated in the associ- 
ation between attachment and children’s external- 
izing problems. Nevertheless, SES does account 
for a considerable portion of the variance in exter- 
nalizing problems in childhood (Bradley & Cor- 
wyn, 2002), and the absence of moderation in this 
meta-analysis is a potentially important result. 
The finding certainly suggests that attachment 
insecurity is associated with higher levels of 
behavior problems even in apparently low-risk 
psychosocial circumstances. However, possible 
effects of SES should not be ruled out, as a broad 
division of samples into low versus high or mid- 
dle class is clearly limited in precision and in sev- 
eral cases the reviewed studies involved mixtures 
of differing levels of socioeconomic disadvantage 
that were not captured in our coding scheme. 

Turning to gender, the results were consistent 
with our expectations and the findings of some 
early longitudinal studies (Lewis et al., 1984; Ren- 
ken etal., 1989), in that attachment was more 
strongly associated with externalizing behavior 
problems in samples of boys than in samples of 
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girls (d = 0.35 vs. d = —0.03, respectively). The set of 
studies on girls was homogeneous; therefore, the 
absence of a significant association was not due to 
one or a few outlying outcomes in the lower range. 
Furthermore, within the mixed sample (boys and 
girls), a metaregression showed a trend for stronger 
effects in samples with comparatively more boys 
than girls. Given that the variation in gender com- 
position within this subset reflected a very narrow 
range, this finding—when combined with those 
from the single-gender studies—provides quite 
compelling evidence of the elevated significance of 
attachment for behavior problems in boys. Never- 
theless, the mixed samples, constituting the large 
majority of the studies, showed equally strong 
effect sizes as those with only boys, suggesting that 
the association between attachment and externaliz- 
ing cannot be ascribed to boys only. 

There are a number of plausible ways of inter- 
preting this gender effect. First, on the face of it the 
effect may not be surprising, given the substantially 
higher risk of externalizing problems in boys (Loe- 
ber & Hay, 1997). However, this broad explanation 
subsumes several distinct possibilities that are wor- 
thy of attention. First, the lower rates of externaliz- 
ing behavior problems in girls may impose a range 
restriction on the dependent variable, which in turn 
would attenuate the effect size (DeKlyen & Green- 
berg, 2008). On the other hand, the lower rates of 
externalizing problems may represent a manifesta- 
tion of a differing set of etiological mechanisms in 
girls than boys, with attachment processes figuring 
more significantly in the developmental trajectories 
of boys. Certainly, some behavior genetic studies 
have suggested partially independent genetic and 
environmental contributions to externalizing symp- 
toms (e.g., Vierikko, Pulkkinen, Kaprio, Viken, & 
Rose, 2003). Furthermore, a number of nongenetic 
studies have documented distinct risk factors for 
girls and boys (Cairns & Cairns, 1984; Cummings, 
Iannotti, & Zahn Waxler, 1989). A further important 
possibility to consider is that attachment (and 
indeed other risk factors) may contribute to a com- 
mon latent process that has distinctive behavioral 
manifestations, which in turn are more commonly 
associated with boys than girls. Pertinent candidate 
examples might include the behavioral and contex- 
tual differences between physical and relational 
aggression (Crick & Grotpeter, 1995) or overt ver- 
sus covert antisocial behavior (Loeber & Schmaling, 
1985). To the extent that these behavioral processes 
are measured by different instruments, are evident 
in different contexts, or are weighted differently by 
different observers, we may expect differential 
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associations by gender. A further important possi- 
bility to consider, which may not be independent of 
the possibilities described earlier, is that insecurity 
in girls is more associated with internalizing prob- 
lems rather than externalizing problems (see 
DeKlyen & Greenberg, 2008). 

In light of claims made by many in the field that 
attachment has persistent effects on future develop- 
ment, we also expected the association between 
attachment and behavior problems to be evident in 
studies with relatively long-term follow-up periods. 
Consistent with this expectation, we found that the 
age of the child at the point when externalizing 
problems were assessed was not significantly asso- 
ciated with the magnitude of study effect sizes. 
Even more intriguingly, among studies employing 
the SSP (k = 43 studies), applied within a small 
time window, effect sizes appeared to increase 
significantly over time. 

In addition to these a priori hypotheses, method 
of measurement proved a significant factor that dis- 
tinguished studies with relatively small and large 
effects in two distinct ways. First, different assess- 
ments of attachment appeared to be associated with 
reliable differences in the magnitude of the attach- 
ment-behavior problems association. Broadly speak- 
ing, the SSP produced smaller effect sizes than the 
other attachment assessments and the AQS pro- 
duced comparatively larger effect sizes. Critically, 
however, it was not possible to disentangle entirely 
the role played by measurement type (e.g., SSP vs. 
other assessments) from the age at which the assess- 
ment was conducted (infancy or later), as these were 
essentially confounded. Notably, age was not a sig- 
nificant regressor within the SSP studies or within 
the non-SSP studies, so a substantial portion of the 
overall effect came exclusively from the difference 
between the SSP studies on the one hand and the 
other assessment types on the other. Although the 
AQS evidenced the strongest effect sizes by some 
margin (d = 0.70), the metaregression of age on 
effect size remained significant even when the AQS 
was removed from the analysis. Thus, while it was 
clear that security assessed by the AQS was rather 
more strongly associated with behavior problems 
than that derived from the SSP, later assessments of 
attachment beyond the SSP also appeared to yield 
stronger effect sizes. On that basis, it was not possi- 
ble to determine whether the critical factor was 
some methodological or coding variation that distin- 
guishes the SSP from the other attachment assess- 
ments, or some factor more closely related to 
development itself. It is certainly plausible that 
important developmental changes take place around 


the beginning of the 3rd year that amplify the link 
between attachment and externalizing problems. 

The second critical measurement factor that 
emerged from this meta-analysis concerned the 
measurement of outcome. Studies that assessed 
externalizing behavior problems via direct observa- 
tion identified reliably larger effect sizes (d = 0.58) 
than those that relied on questionnaires from par- 
ents or teachers (d = 0.22 and d=0.30, respec- 
tively). This is a potentially important finding from 
a variety of perspectives. First, the vast majority of 
the studies that investigated externalizing behavior 
in relation to attachment reviewed here did not use 
any objective source of information concerning the 
outcome. Not only does this strategy limit the con- 
clusions that can be drawn (see Kagan, 2007), it 
could also partially explain the mixed effects across 
attachment-outcome studies as a whole. It is note- 
worthy that the effect sizes cited earlier are appar- 
ently positively correlated with the degree of 
objectivity of the observer. 

Nevertheless, although the objectivity of mea- 
surement is one potential account of the stronger 
effect sizes associated with direct observation, it 
could also be that direct observation reveals quali- 
tatively distinct features of behavior or qualitatively 
distinct contexts in which behavior takes place. 
Notably, studies that used observational methods 
typically focused on the peer setting (e.g., Booth, 
Rose Krasnor, & Rubin, 1991; Matas et al., 1978; 
Suess, Grossmann, & Sroufe, 1992) and hence may 
have been tapping behavior more closely connected 
with social competence than those that relied on 
parent or teacher questionnaires. However, these 
effects are understood, the limited agreement 
between objective observers, teachers, and parents 
concerning children’s behavior problems creates a 
strong imperative to use multiple sources of out- 
come data in future studies of attachment security 
and its sequelae. At the same time, more data 
sources per se will not solve this problem. What is 
arguably needed is a better understanding of the 
precise circumstances and mechanisms under 
which aggression and other antisocial acts may be 
triggered and the contribution that attachment pro- 
cesses make to this. It is hard to imagine that this 
degree of mechanistic specificity could be achieved 
without greater reliance on field studies that 
involve direct and extensive observations in a range 
of relevant social settings. 

Arguments put forward in the literature, and 
results of an earlier meta-analysis, led us to expect 
that attachment disorganization would be a stron- 
ger predictor of externalizing behavior problems 


than attachment insecurity generally (van IJzendo- 
orn et al., 1999). However, the findings of the cur- 
rent meta-analysis were only partially supportive of 
the special status sometimes accorded to disorga- 
nized attachment as a precursor of children’s exter- 
nalizing problems. The global effect size for 
attachment security (d = 0.31) was very similar to 
that for disorganization (d = 0.34). It should be 
noted that these effect sizes do not reflect the out- 
comes of the same set of studies so direct compari- 
sons are difficult. However, in an analysis of 19 
studies where data from all four attachment groups 
were available the results corresponded to the 
aforementioned global effects. The effects for secu- 
rity and disorganization were significant and of 
similar magnitude (d = 0.27 and d = 0.29, respec- 
tively), while the effects for avoidance and resis- 
tance were small and in the case of avoidance 
nonsignificant (d = 0.06 and d = 0.11, respectively). 
The 85% CIs for security and disorganization did 
not overlap with that for avoidance, suggesting 
significantly stronger effects for insecurity and dis- 
organization than for avoidance. The effect for 
resistance did not differ from any of the other con- 
trasts, in part because this effect showed marked 
heterogeneity. Furthermore, in the larger set of 
studies, resistant attachment was not significantly 
associated with externalizing problems and showed 
an effect size numerically similar to that for avoid- 
ance. When only studies that provided direct pair- 
wise comparisons between groups were 
considered, secure children scored lower on mea- 
sures of externalizing problems than disorganized 
(d=0.27), avoidant (d=0.12), and _ resistant 
(d = 0.19) children, and while the CIs for these 
effects overlapped, disorganized children demon- 
strated numerically larger effects than the other 
insecure categories. 

Although the effect sizes for disorganization and 
security compare favorably with other prominent 
risk factors for externalizing behavior, they also 
leave room for the possibility that the association 
may be moderated by other factors. It is highly 
noteworthy that few if any of the studies reviewed 
in this study directly addressed questions of mech- 
anism. Arguably, until mediating mechanisms are 
better understood, we may struggle to find the rele- 
vant moderators. Given that an association clearly 
exists, there is an obvious need for strong theory- 
driven studies that address mediating processes, 
particularly those drawing on methods derived 
from other fields. Some well-studied risk processes 
worthy of consideration (in addition to the tradi- 
tional internal working models construct) include 
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impulsivity, negativity emotionality, affect regula- 
tion, hostile attributional biases, and physiological 
hypo-arousal (Belsky, Fearon, & Bell, 2007; Dodge 
& Coie, 1987; Eisenberg et al., 2001; Raine, Ven- 
ables, & Mednick, 1997). Risk factors such as these, 
situated at the biological, cognitive, or affective 
level may be considered proximal determinants of 
externalizing behavior, with the quality of the 
attachment relationship with a primary caregiver 
conceptualized as a more distal determinant. A cru- 
cial question in that context has long been, and 
remains, the extent to which longitudinal continu- 
ities in the effects of attachment represent the ongo- 
ing supportive function provided by _ the 
attachment relationship as opposed to the early 
effects of attachment experiences on the emergence 
of stable psychological structures, such as internal 
working models. It is notable that Belsky and Fea- 
ron’s (2002) analysis of the NICHD data at age 
1-3 years suggested that the effects of attachment 
tended to persist primarily when there was conti- 
nuity in the quality of maternal care. Given the cen- 
trality of this issue and the cogent arguments made 
by several authors on this subject (e.g., Sameroff, 
2000; Sroufe et al., 2005a, 2005b), it is unfortunate 
that few studies have attempted to address this. 
Related to this, few studies have directly consid- 
ered the possibility that certain parenting character- 
istics may be common determinants of both 
attachment insecurity and externalizing behavior 
problems. Thus, the extent to which attachment 
processes per se can be shown to make a specific 
and causal contribution to children’s externalizing 
problems, either independently of parenting or as a 
causal mediator of its effects, remains to be seen. 

There is also a clear need for a better under- 
standing of causation. In that regard, the absence 
of studies that have repeatedly assessed both 
attachment and outcome is a significant barrier. 
Longitudinal studies that employ cross-lagged 
panel designs could provide elegant tests of cau- 
sation by focusing on temporal ordering. How- 
ever, in order to do this there is an urgent need 
to establish robust measurement protocols that 
allow for meaningful repeated assessments of 
attachment and hence the documentation of 
change. Of course, causal hypotheses can also be 
powerfully addressed by intervention studies 
(Bakermans-Kranenburg, van IJzendoorn, Mes- 
man, Alink, & Juffer, 2008) and in the future 
these may be critical for determining the role of 
attachment in children’s behavior problems, as 
well as that of the causal mediators and modera- 
tors of its effects. 
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